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ABSTRACT 


In partial response to a memorandum for the Superin- 
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NewoasO@peractzens (Serzal 922621/587526 dated 24 April 1978), 
this thesis attempts to analyze the historical relationship 
between the Navy's investment in current RDT&E and future 
investment in procurement. Utilizing data from fiscal 
years 1962 through 1979 and single equation econometric 
forecasting techniques, linear models predicting procurement 
one to four years in advance based on current RDT&E are 
developed. From time-series data, with the models adjusted 
for serial correlation of the error terms, ex post forecasts 
and confidence interval estimations are used to evaluate 
the extent and usefulness of the predictive relationships 
discovered. 

Fight separate models are developed, and analysis of 
results indicates the existence of a predictive relation- 
ship. However, there are also indications that the basic 
relationship may have changed during the period under study. 
The relative inaccuracy of forecasting methods when earlier 
data are ignored makes the usefulness of these procedures 
to those who shape future Navy budgets difficult to 


determine. 
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Le END RODUCT LON 


The analysis to be conducted in this thesis was 
Originally proposed by a memorandum from the Director 
of the Fiscal Management Division, Office of the Chief 
Of Naval Operations, to the Superintendent of the Naval 
Postgraduate Schoo1.? Appendix A contains a copy of that 
correspondence, which expressed concern that more and more 
promising new weapons programs were being terminated 
because their estimated procurement costs made them 
unaffordable. At the same time, the Department of 
Defense waS cOntinuing to increase its research and 
development erforts. For example, the fiscal year (FY) 
1979 Navy Research, Development, Test, and Evaluation 
(RDT&E,N) appropriation request provided a real program 
SsOwen Of aDOut Six cercent over the FY 1978 level. The 
memorandum implied chat the increasing complexity and costs 
of modern systems, at least in part, resulted from earlier 
research and development effort; and the memorandum expressed 


an interest in developing, 1f£ possible, a predictive model. 


tAlthough the correspondence is officially from the 
Office of the Chief of Naval Operations (OPNAV) only, its 
author and most of his subordinates also hold positions in 
the Office of the Navy Comptroller (NAVCOMPT) under the 
Secretary of the Navy. To avoid confusion, future refer- 
ences to this correspondence, the analysis or the persons 
who conducted it will use the modifier "OPNAV/NAVCOMPT". 





Seccitically, based Upon Ehe Current investment in research 
and development, can future procurement requirements be 

predicted? The OPNAV/NAVCOMPT staff conducted a preliminary 
Siedey «1 PurSUte Of Chis question, and a discussion of their 


analysis follows. 


A. THE OPNAV/NAVCOMPT ANALYSIS 

The analysis conducted by the OPNAV/NAVCOMPT staff 
was limited to eighteen individual development/procurement 
programs included in the FY 1979 budget submission. These 
programs were all in the engineering development Stage and 
had progressed to the point of having budget quality esti- 
mates of both total research and development and procurement 
costs through the program years (the four years beyond the 
budget year) [{Refs. 4 and 5]. For each of these programs 
a ratio of total procurement costs to total research and 
development costs was calcuated. This ratio was then 
adgusted or weighted by the orogram'’s £Eraction of the 
FY 1979 RDT&E,N Sono The sum of these individual 
weighted factors then equated to the relationship between 
research and development and procurement costs: for every 
dollar of RDT&E,N, the Navy could expect to spend approxl1- 


mately four dollars procuring the associated weapons systems. 


“weighted Factor = Procurement to RDT&E,N Ratio x 
[Program FY 79 RDT&SE,N — Total Sample RDT&E,N]. 





The limitations of such a study are more or less 
obvious. The study addresses only a single year's data, 
and much of those are estimated. There exists a wide 
variance among the calculated procurement to research and 
G@evelopment ratios (from a high of 33.2 to a low of 0.4). 
Thus, what may be true for this sample may not necessarily 
be true for a different one. The amount of RDT&E,N money 
included in the study represented only 25 percent of the 
total RDT&E,N budget request. Finally, the ratios of 
procurement to research and development were apparently 
ealemlatea without adjusting costs to consistent or con- 
Seca@enagollar flgures. The study mixed dollars of past, 
present, and projected future purchasing power. Adjusting 
for this difference would not be an easy task in light of 


the way in which the data were presented. 
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If. AN EXPANDED STUDY 


This thesis will expand the study of the relationship 
between procurement and research and development costs. 
Investigation of possible methods of conducting this 


expanded analysis produced two general alternatives: 


A. ALTERNATIVE METHODS 
Pople. Micro Approach 
This alternative would proceed in an effort to 
identify individual programs for which RDTS&E,N and procure- 
ment investments had been made. These data could then be 
aggregated to provide a basis for estimating the overall 
relationship of procurement to research and development in 
much the same manner as the OPNAV/NAVCOMPT analysis. [In 
addition, individual programs could then be categorized 
in such a manner as to study particular types of systems 
(e.g. high performance aircraft or surface radar systems). 
Zaye Loew Macro Approacn 
This alternative would use aggregate historical 
budget data rather than figures for individual programs. 
The relationship of total RDT&E,N to a total of the Navy's 
procurement accounts could be studied, as well as relation- 
ships by program budget activity or Department of Defense 
MPO) program category (e.g. RDT&E,N for aircrart and 


missiles versus procurement of aircraft and missiles). 


dua 





The macro approach was chosen for several reasons. 
Heese, PULSUIt Of Ehe micro approach with the thought of 
logically connecting each dollar spent in RDT&E,N to an 
item of current or future procurement would have fallen 
well short of that goal. There eee Significant por~eien cf 
the total RDT&E,N budget, such as basic research and manage- 
ment and support, which could never be "applied" to a 
particular procurement action in other than an arbitrary 
manner. Secondly, what historical data we now have con- 
cerning the RDTSE,N and procurement monies spent on 
specific programs are made available mainly through Selected 
Acquisition Reports (SAR's) which are submitted by the Navy 
to the Department of Defense. These SAR'sS provide a means 
of tracking costs on a regular basis. Unfortunately, these 
reports cover only major programs (over $75 million RDTS&E,N 
and/or $300 million procurement) and go back only as far 
as 1970 [Refs. 3 and 6]. Finally, an attempt to trace 
historical RDT&E,N detailed program element data to pro- 
curement data for the major programs or for the myriad of 
smaller programs would have resulted in an excessively 
time-consuming data extraction process and, in the end, 
would still have left much of the RDT&E,N investment 


Moneccounted Tor. 


B. ASSUMPTIONS AND DEFINITIONS 
The most basic assumption underlying any financial 


analysis is that human behavior can be reasonably and 


2 





accurately represented by a dollar figure. More specif- 
meally in regard to this study, human behavior which we 
might define as the "level of effort" in research and 
development and the "level of effort" in procurement are 
assumed to be susceptible to representation by dollar 
Figures. But which dollar figure among the many available 
in the DOD budgetary process best represents these levels 
Cmecrtore: Terms like authorization, appropriation, outlay, 
expenditure, budget authority, new obligational authority, 
meeal OoltgGational authority, budcét activity, program, 
total program, DOD program category, reimbursements, reim- 
bursable, budget plan, and obligation are not easily, 
widely, or fully understood, in spite of the many text 
book definitions available. 

Appendix B is a glossary which will provide the reader 
with definitions of terms as they are used in this analysis, 
but additional explanation of this thesis' answer to the 
Guestion posed above (i.e. which dollar figure is best) is 
in order. Table 1 presents a page from The Budget of the 
United States Government, 1970 ~ Appendix and will serve 
as an example of the complexity (and in some cases inconsis~ 
tency) of terminology and as support for the answer at which 
we will arrive. 

Table 1 presents the schedule of program costs and 
financing for the Navy's procurement of aircraft and mis- 


eames —(PAMN) appropriation account for FY 1970. This 


ee 





TABLE 1 


PROCUREMENT OF AlgpcrarFr AND Missrzs, Navr—Continued 
Program and Financing (in thousands of dollars) 









































; ; Budget piso Obligntions 
Identification coda (amounts for procurement actions programed) 
Q7~ 15~1505-0-|-051 ——_—__---_--ss 
1968 actual [960 catumate 1070 estimate 1968 actual 1969 estimate 1970 estimate 
Program by activities: 
Dwect: 
} ERT SCD te g. | a hee ae a a 1.535 ,275 1,503,340 1,494,100 1,683,371 1.484, 600 1,570. 300 
Deere Snceait eo aol Soe ek pe eee 15,039 36, Nee te 9.200 27,700 
SAU et MURAI C6 os os Sn sk mint enlcwmm ence 73,798 33,415 110.290 81,322 83,200 104,300 
BME neg M UCT BIe ico af ee ea So 7 ee ee 8,0 4,144 11.00 10,600 
PrelociNeation OF AUCPAIS 2-2 = 22 oo cee ecu cennccnacenc 441.062 401,253 325,900 469 680 405 .200 341,200 
6. Aircraft spares and repaw parts_...- 2 eee 606 , 066 373,626 384,200 632.909 390 ,000 533,400 
7. Aweraft support equipment and facilities... ....-.-- 22-2. - 99 301 101,500 99,100 96 877 RR | 97,300 
Me MIlNtIC TISSUCS.o. .. coos cuus soe See oae es Samoweeceuec ce 175.039 384 680 517.900 39 496 330,500 455,000 
CR EROS Slee ee oe iti Sare i Bo ae eR oD 329,203 326.941 258,000 535,299 325, 400 232, 400 
10 Nlodification of missiles... coe ce cen concaccccccccececee 20,820 19,345 27,000 7 Ee be 15,400 19,900 
$1. Missile spares and repair parts... 2 eee eee ene e ee 25.743 21,971 38,900 25 20,3800 27 ,C00 
12. Missile support equipment and facilities. 1-2-2222. 28 _ 29,966 16,779 23.300 20,023 16,500 22,400 
SR OCR directo ee carte ee owen oa re ntsc pate ewue xen 3,340,538 3,248,387 3,524,000 3,457,811 3,180,600 3,512, 400 
———————SSS 
Reimbursable: 
7. Airereft support equipment and facilities... 222.222.2222. ee 29.281 26,000 26,000 14,585 15,000 15,000 
12. Missile support equipment and facilities... ele 17.240 21.000 21.000 19,857 20.000 29,000 
otal veunburisbiessensce ence eo een. Cycle aoe 47,021 47,000 47,000 34,442 35,000 35 Cd 
SE EES 
10 Siicrtn beeen eee 8k ioe eo eee Ai ace 3,387 (559 3,295,387 3,571,000 3,492,253 3,215,000 3,547,400 
Financing: 
Receipts and reimbursements from: 
i! erie AMOS hoo oo nic, ten oe dow oa bececaceakoocoscues : ~ 35,310 — 35,300 —35,300 — 19,233 —35,300 —35,30 
MNUNINC itr S 7 fs os oc eck ceaece ce osbi ote cdecsse ee —22,317 —22,.300 —27,300 —19,539 —22,300 —22,300 
[NM INOMePecieral sources |. 3 oe oe oon co ann w ee cceccconucs —4,3% —4,400 —4,400 -3,991 —4,400 —4,0 
2] Usoblicated balance available, start of year: 
emeceip culo di oriDr Vear Dudeet Pane os: ooo oo Bee ceo 22 ee eae hb coweee eee es UN eeecuueceec —$.572.837 —1.212.814 —41,202.514 
Avatiable to finance new budget plans... cece wee e ecw ee cee ee ee -eue- mSOLUOU acne tecee ce. seeancacass = 159000 Sac occ ocaseae 
Reprograming from pnor yesr budset pians.....--2.------.---- ee — 243,638 —90 037 — 13, OM)  cooeceeec een eo eeece teas eee ae eer 
22) Unodlicated balance transferred from other secounts....-2 eee ene e ene ee ne —410,900 — 25,000 7517 —410,000 — 25,000 
24 Unobligated balance available, end of year: 
Poricamolelion of orior Year bUdzet GlAAS oo o6os cca ncuseaccuac Uueecceacsees  ceccececcces “susecosswse 1,212,814 1,202,514 1,150,134 
Avaiable to finance subsequent year budget plans........--...-. 9 OO a cea eters Saeco ees cee PS OU Goa on eau cat eeeteteconeae 
Budget authorsty_...- 222-22 eee ee eee ee eee 3,240,900 2,574,300 3,409,000 3,210,500 2,574,300 3,109,000 
Budget authonty: 
UL Pere yy 2y pC ae ne 2,939, 100 2,574,300 3, 409, 000 2.939, 100 2,574,500 3,409,000 
42 Transferred from other accounts_.....-..-------- oe ene oe nnn BON E00 ose Bees Te eae es DUE OU | cemaebonceuetececaueweres 
43 Apprepristion (sdjusted)__..-2 0 oe ee eee eee eee 3,249,900 2,574,300 3,409 ,000 3,240 ,900 2,574,300 3,409,000 
Relation of otlizations to outlays: ? 
Uo Eat onthe ah SS Ree cre (ca ll oR eA Se nme ne RR BO ees ere 3,449, 440 3,153,600 3,485,200 
72 Obligated bajance. start of JOT on nnn een owes onc nce na cw ees cccn saws nn cc aecces esecccccetesecesceusscuvecocs 3,764, 367 3,571,799 3, 120,399 
PAMGUNinatedina aNcecend OF YORE 256 orc co cececbsncucccquecewenckecae aeennasundssansscecssseessnceceseess< —3,571,799 = —3,120,399 —3,265,799 
cu arb lays see ee ee he eee eon ae aa te eocee suse ae eR senesese-eceoeeesscesene= Be 3, 642.008 3,605,000 3,340,000 
t( Resmbureemeo ro oo-Federal sources are derived principally from cash aelea to foreign governmancts 
ef Bae teehee Fe acho speres and repaw partes (22 U.S.C, 2315), : 
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schedule provides actual figures for the previous year 
(1968) and estimates for the current year (1969) and budget 
Wecine (1970). t 1S presented in three main parts: (1) the 
program-by-activities section, (2) the financing section, 
ama) (3) the section on relation of obligations to outlays: 

The program-by-activities section presents the results 
of the executive branch's programming function in terms of 
Financial requirements by budget activity. This classifi- 
cation by budget activity is not consistent throughout the 
Buag@er fOr each appropriation nor is Lt consistent with the 
BOD ClasSification by program category [Refs. 2, 5, and 7]. 
The former characteristic reflects the fact that each 
appropriation account is divided among several budget 
activities and that these vary from appropriation to appro- 
Prlation. The latter indicates that DOD program category 
classification (e.g. strategic forces, general purpose 
forces, etc.) has an orientation entirely different from 
EaemaoprOopriation's program-py-activities section. This 
necessitates the function known as "crosswalking", or being 
able to shift from budget appropriation to DOD program and 
back again [Refs. 1 and 4]. 

[Mae financing Section Shows the sources of funds (budget 
authority, receipts and reimbursements, unobligated balances 
available and amounts transferred in, etc.) which wiil be 
used to support the financial requirements as determined 


above. 


LS 





Mie relarion-Or-obligation-to-cutlays section Shows 
obligations net of offsetting collections at the start and 
end of each year and presents the actual net cash outflow 
as a result of the programming and budgeting activity 
Genaucted in connection with this appropriation account. 

The appropriation (adjusted) section is included when 
required for the year prior. It merely shows what portion 
of the appropriation for that year was actually transferred 
Maom OtNner accounts. 

Selection of that dollar figure which would best repre- 
sent the level of effort is based upon the definitions of 
the terms programming and budgeting as they are used in the 
context of the Federal financial management process. Pro- 
Gramming 1s defined as the process of translating planned 
Military force requirements into time-~phased manpower and 
Material resource requirements. Budgeting is defined as 
the process of translating approved resource requirements 
(manpower and material) into time-phased financial require- 
ments [Ref. 5]. Where these processes interface, that is, 
where time-phased manpower and material resource requirements 
are first stated in terms of financial requirements appears 
to be the point at which to determine the best financial 
representative of “level of effort". The dollar figure at 
Sie epOint (refer to Table 1) is the total direct program 
figure and represents the financial requirements of each 


budget activity necessary to support approved programs. 


16 





This total is the equivalent of the more commonly-used 
term, total obligational authority (TOA). However, it is 
not simply new obligational authority plus unobligated 
balances, which is the most frequently heard definition of 
TOA [Ref. 1]. 

For the purposes of this study, the data used will be 
the total direct program by budget activities for the 
Navy's Research Development, Test, and Evaluation (RDT&E,N), 
and the Navy's procurement accounts (PAMN - Procurement of 
Aircraft and Missiles; WPN - Weapons Procurement; APN - 
Aircraft Procurement; OPN - Other Procurement; and PMC - 
Procurement, Marine Corps). These data will be actual 
historical data in so far as practicable. For fiscal 


years 1978 and 1979 the data will be estimates only [Ref. 8]. 


Seyeee  FOTRESIS 

The general working hypothesis under which the remainder 
@emenes analysis will be conducted 1s as follows: there 
exists a predictive relationship between current Navy 
research and development efforts and future investments 


Im, procurement. 


Ly 





Pit ae ln METER ODCLOG 


A. THE DATA 

AS indicated above, data used in this study will be 
the total direct program figures for the Navy's RDT&E and 
procurement accounts. These have been taken from the 
annually published Budget of the United States Government 
---Appendix [Ref. 8] and, except for FY 1978 and FY 1979, 
will be actual figures. That is, the amounts will originate 
in the budget plan's “actual" column of the program-~-and- 
financing section for each appropriation. For example, the 
figure for the Navy's 1968 PAMN account is obtained from 
iiemoucoe: (Or the Unlted States Government, 1970 = Appendix: 
Mieweoeal direct FY 1968 PAMN program 1S $3,340,533,000, 
as shown in Table l. 

Data were collected for each full fiscal year starting 
Wimewel 962 and ending with Mono It was felt that this 
time span would provide enough data to develop a predictive 
Megdelmre ©2n fact, such a relationship existed... Of course, 
the k£igures contained in the budget documents are in current 
Meceemcollars, and an adjustment to constant dollars (PY 
1979 dollars in this case) was made prior to the conduct 


SuMmete analysis. Factors for converting currene dollars to 





3pata from the transition quarter of 1976, designated 
19T0, were ignored by this study. 
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constant FY 1979 dollars were obtained for each appropria- 
eromeadcCOunt aS promulgated by DOD on February 10, 1978. 
Appendix C contains in tabular form the current dollars, 
Begasting factors, and constant dollars for all of the 


quantitative data used in this study. 


Pees loat MODEL 


The basic principles of econometrics and economic fore- 


caSting will be used to determine if 
dictive relationship between current 
future efforts in procurement. This 


described initially by the classical 


there exists a pre- 
SEFOrts in RDTSE and 
velaeri.onsni pw. be 


normal linear regression 


model: 


where 


Y = the dependent variable, 
X = the explanatory variable, 
e = a random error term whose values are based 

perm aneuneeriying prebabliatry G1strilpuciton, 
a and b = regression parameters which are unknown, 
anc Y are Observable bue ells MCE, and 

Z el 

the subscript t refers to the t observation 


[Ref. 10]. 


ggg 





In this analysis the explanatory variable, X, will 
always be the RDT&E,N direct program in the budget year 
(BY), while the dependent variable will be one or a total 
of the Navy's procurement direct programs for one or more 
of the program years. Since these observations are made 
Over time, they are often referred to as “time-series data" 
bRet, 10]. Thus, the subscript t is used rather than the 


more common i. 


C. ASSUMPTIONS 

In addition to the general form of the model as expressed 
in equation (1), the classical normal linear regression 
model must conform to the following basic assumptions. 

lee Normality 


The error term, e is normally distributed. 


ee! 
2. Zero Mean 
The expected value of the error term, Ele,), 1s 
equal to zero. 


pee -Homescedasticlty 


Every disturbance, e 


2 
has the same variance, S , 


ee! 
whose value is unknown. 
fea NONStTOCRaStIC x 

The explantory variable, Xr i= HONS tEOChtas eC 


(nonrandom) with values fixed in repeated samples and such 


that, for any sample size, 


NO 


n 
ay — 
a See 


t=1 





1s a finite number different from zero. (X is the mean 


value of all Xs and n is the number of data pairs in the 


sample.) 


or Nonautoregression 


The error terms, e are uncorrelated ina statis- 


te! 
tical sense [Refs. 10 and 12]. 

This analysis assumes that the data conform to all 
of the basic assumptions listed above except the fifth, 
nonautoregression. This assumption is most often violated 
by relations estimated from time-series data [Refs. 9 and 
10], and the analysis will proceed on the opposite assump- 
tion, determine the extent of autoregression or serial 


correlation present, and make the necessary adjustments to 


the model. 


Pee? ROCEDUREAL DETAILS 
For each set of data, certain steps will be taken in 
the following logical sequence. 
1. Ordinary Least Squares (OLS) Regression 
The method of least squares will be used to provide 
estimates of the model's regression parameters a and b 


where 





and 


Pap 





nye. See) Sos 


2 2 
ees) 


n)X, 


mers DEocedure in graphic terms results in a straight line 
which minimizes the sum of the squared deviations of the 
data points on the graph from the points on the straight 
line (with distances measured vertically). 
2. The Hildreth-Lu Procedure 

Autoregression of the data's error terms has been 
assumed. The next step 1S to determine the extent of first 
order serial correlation present, if any, by using the 
Hildreth-Lu procedure [Ref. 12] to estimate a new parameter, 
r, which is the correlation coefficient between errors in 
elmer Dperiod t+] and errors in time period t. 

In this procedure, a set of values are specified 
Bewer, Gnd for each value of r, another OLS regression is 
conducted and error sum of the squares (ESS) * ca leudaced 


on the following equation. 


Yy ar(k= i) DX, 
where 
* = Sons 
ee a CY, 
tess = The sum of the squared differences between the 


estimated and observed values of the dependent variable. 


Ze 





and 


The procedure selects that value of r which results in 
the lowest ESS, guarantees a maximum likelihood estimate 
of r, and may be repeated until the desired accuracy is 
achieved, to the nearest thousandth in this instance. 

3. Generalized Differencing 

By this procedure the original model is changed into 
one for which the error terms are independent. The result 


is the transformed equation, 


* _— -_ * 
vy a4 2=—2) + DX, + Ves (2) 
where 
x = 2 
hs er eee 
x ¥e _ ites 
ae Oe eet 
and 
ie Seas SO, ac 


are the generalized differences of Ys Xi and e,, respec- 


tively. The transformed equation (2) has an error process 


aS 





which is independently distributed with zero mean and 
constant variance, and an OLS regression applied to it will 
produce estimates of all the parameters. The intercept 
of the original model, however, must be calculated from 
the estimated intercept aeeeetare with equation (1) 
(Ref. 12]. Thus, once the correlation coefficient of 
the error terms, r, 1s known or has been estimated, it 1s 
a relatively simple matter to adjust the original model. 
ae Porecasting 

Having completed the procedure as outlined above, 
the estimates of a(l-r), b, and r as they appear in model 
(2) have been obtained. These are then substituted into 
the model along with expressions for the generalized 


@itterences of Y,, xX and 2. 


1a tie cm 
_ = a = + = 

Soe et ees ee eee 
A forecast value of Yea! denoted by Yee] may then be 
obtained: 

. = — 3.4 = oe. 3 

are sa os ale ae > ara brX, 3) 

= ; Gali OM 

The error term, ve are] re, has been droppe 
eemeeion (3) for reasons of clarity. Without proceeding 


with mathematical proofs, the variance of the forecast 


error which will be used to obtain confidence intervals 


wn 


about the point estimate (Y ) 1s given by 


Bol 
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V £ 
where 
S. = s*tl+o+ ats ill (4) 
(X_ — X) 
Soe — ogee eh 
and 
T = the number of observed pairs in the 


Original data set. 


Mme 95% COntidence interval uSing the Student's t distribu- 


freon for Sarees | is 


ag) 7 = Seer. 2a = il : Ce : ops n=? oe 
Oy) 
where 
Ss. = the standard error of the forecast (7) 
- 2. Be 2 
= S., = (l-r } S¢ 
and 
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ie ee See Nea ue Or seer ere seri let On ween 
PO PASTS Slat” 

n-2 degrees of freedom such that 
2.5% of the area under the curve 
fies tev ele ign: Of trate value. 
Provides the basis for a two-sided 
hypothesis test at the 95% level 
of significance [Ref. 11]. 

From equations (3) and (4), the statistical accuracy of 

the prediction is dependent upon the size of the sample, 

the range of experience of the explanatory variable xX, 

the distance between the new explanatory variable Keays 

lo 

and the average value of all X, X [Ref. 12}. 

5. Presentations 

For each set of variables the following presenta- 
tions will be made: 

a. A table of obServed variables, variables in 
generalized difference form, and ex post forecasts. Data 
will be rounded to the nearest million and expressed in 
Peel g79 collars. 

b. An expression for the OLS regression in the 
EOL, 2 = a + bX 

Gu “Anvexpression Of Ehe new,. corrected cor adjusted 


w~ 


regression in the form Y = ry. + pai ( dea) eas =O 


ee. is 


dad. A table of data which will include for a range 


t+] 


of values of the explanatory variable ( yn ene pont 


las 


estimate cf the dependent variable (Y 


Ses] 


bey? from equation (3), 


2 
Ene Variance of the forecast error (S.°') from equation (4), 


von 
ae 


the standard error of the forecast (S..) GoM egal) ens) a 
and the width of one side of a 95% confidence interval from 


EQuatlon (6). 
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Gs. Ao Orapn- with. procurement (Y,) measured along 


the ordinate and RDT&E,N (X_) along the abscissa, displaying 


a 
the data points, the OLS regression line, the adjusted 
regression line, and 95% confidence bands about the adjusted 
regression line. 

£. A graph of procurement and RDT&E measured along 
the ordinate versus time measured along the abscissa, dis- 
playing observed data, forecasted results (i.e. what the 
model would have predicted), and 95% confidence bands about 
the forecasted value. The width of these confidence bands 
1s that of the “next" forecast 1f the explanatory variable 


(X ) were exactly equal to the average of the previous 


eau 
Seelanacory Variables (X). Thus, it is as narrow as it 
can be and, for the pourposes of presenting pictorially now 
well the model predicted ex post facto, presents the most 
Migerous test. in addition, a numerical expression of the 


ae 
goodness of fit over the entire time period, R , 1s 


provided. 


22 _ Regression Sum of the Squares (RSS) 
~ Total Sum of the Squares (TSS) 


where 


TSS = The total variation of the dependent 
variable. The sum of the squares of the 
difference between the observed values 


of Ye and the average value of Yee 


and 


oe 





RSS = The explained variation of the dependent 
variable. The sum of the squares of 
the differences between the forecasted 
Or predicted values of Y, and the 
average value of Ye. 


Re expresses that fraction of the total varlance 
of the dependent variable which is "explained" 
by the explanatory variable. 
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Ven (lite eoUe lS 


The results of the analyses will now be presented as 
described in paragraph II.D.5. The first four analyses 
will match budget year RDT&E with a single year of total 
Navy procurement one, two, three, and four years in the 
future. The fifth analysis matches budget year RDT&E 
with the aggregate of total Navy procurement in the program 
years, and the remaining three analyses explore alternatives 
along Similar four-year aggregate procurement totals, again 
uSing RDT&E as the explanatory variable. 

For each set of variables, denoted by second-order 
headings (A,B,...,H), the following presentations will 
made under corresponding third-order headings: (1) A 
table of observed variables, variables in generalized 
difference form and ex post forecasts (more fully explained 
Pieearagqraoh [II.D.5.a). (2) An expression for the OLS 
regression in the form 

Y= o + Ae 
tome woaragraph Iii.D.5.5). (3) An expression for the 


new regression in the tform 


(Gee Daragraph ILi.:D.5.c). (4) A table of data which 


includes for a range of values of the explanatory Var Laoee 


Ze 





NN 


(Xi yy)e the point eStimate of the dependent variable (Y ie 


jai 
the variance of the forecast error Cioy the standard 
error of the forecast (S), and the width of one side of 

a 95% confidence interval (cf., paragraph III.D.5.d). 

In addition, two figures, numbered sequentially, will be 
provided for each set of variables, the first showing 
pictorially the relationship between Procurement and RDT&E,N, 
and the second showing the relationship of both over time 


as well as the model's forecasted results (cf., paragraphs 


Meee Soe and LELD.5.f) . 
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eee ROCUKREMENTD IN’ BUDGET-YEAR-PLUS-ONE VERSUS) RDT&E, N 
{TN BUDGET YEAR 


1. Observed Variables, Variables in Generalized 
Difference Form (r = 0.462), and Ex Post Forecast 

FY Xx X* FY ¥ 4a etl 

62 3025 ----- 63. .19628 ~“—--—= -—— 

poeeeo394 1996.45 64 16449 7380.864 16998 
64° 3473 1904.972 65 14580 69802562 15796 
Sommousy 1482.474 OG ES6e7 11951. 04 16 LS 2 
Sowess52 1905.806 67 19380 10746.606 168206 
epmeeo76ol 2421.616 66° e527 1 6317.44 P5655 
S@e5) 3604 1854.018 69 13822 6766.798 ey See? 
eoeeea4075 §2372.992 70° 14801 S405 4:2 BiG 13228 
fees) 2128.35 PAs hens 6566.938 1LeOs eae 
fest le 61 B64. O18 eke sk, 8316.89 la S03 
fee 3865 2147.284 $24 eed ee 7040.38 14198 
feeeeso4) 2055.37 fi: ime e516 Boa wc 2 14110 
Pees 7/55 1980.458 75. 268793 So 3.166 13662 
veoeeoeoS 62158 .19 76a, Zee F305 290 2 PStome., 
fioemes99l -2192.434 G7 eves 7 9089.616 13061 
OwyeeeaZ297 8 82453.158 Fics egal les lea 8290.406 ieaa2 
fomma2606 2280.786 19 13393 69322636 14090 


PeevOlLS Regression: Y =. 31195-8483 = 4.3461 % 


3. Regression Line Adjusted for Serial Correlation: 


Yee] = ry, + a(l-r) + DX, +1 - DIX, 
= - D 
tea ANS 0 teal OMS 32 al BS 2) ie cae ee 0) Oe ae 2.8905X,., + (2.8905) (.462) (4266) 
ttl] = 58278.55863 —=~270905 Xeay 
4. Data Table: 

: ‘i 2 
Se41 Tet] S§ Sy © 025;n-2 °v 
1000 22938 15565656 0.0 3499 74556 
2000 ZUO47 8504593..073 2556 Sys ples 
3000 Dei Say 4589076.808 1900 4049 
BS LES 0G3 S76 O17. 22 le IO) 3643 
4000 74266 3818107.809 L338 3693 
5000 Lisa 6 6191686.073 2207 ee Oe 
6000 8485 11709811.60 30135 6467 
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TOTAL PROCUREMENT IN BUDGET-YEAR-PLUS-ONE (billions) 


ae 


ZO: 


(poe 


eIGURE | 





KEG - a 
DATA POINTS a ae 
OLS: LINE —— 
ADJUSTED REGRESSION LINE 


952 CONPIDENEE SANUS sh > 2° es 


Yeay = 25828.35863 - 2.8905X,.1 


ro 0 oD 4.0 
ROT&E,N in BUDGET YEAR (billions) 


Be 


oe 
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FIGURE 2 


—~ Kee 
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— \ 7 yao ae = 
a ” 
a ® sd ee 
312.5 
a) 
ce 
ee 
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Pree hCCUREMENT —IN BUDGET—YEAR-PLUS-TWO VS. RDTSE,N 
IN BUDGET YEAR 


im (Coserver Variables, Variables, in) Generalized 
Difference Form (r=.446), and Ex Post Forecast 


gag X Ss igo M4 ae es) 
Seo 2> ===> 64 Woego Saas seca 
63 3394 2044.85 65 14580 F243. 746 ibeyayo! 2 
64 3473 LOS Ii27 6 66 18637 BE 3s a jE a ORE, 8 
Seu sus/ ere st 42 67 Hes e219) POA 250 5 e272 
S67 5352 oS S 68 NE Sia IE GO27lo2 Hey kieys) 
oy 76) 2474.928 69 PSeg2 70134 13560 
68 3684 ds le Sree 70 14801 S636. 550 143814 
oo 240 /> 2 ho oO rol 13405 sits 0) Seay iee Tao 7 
nO 40 11 Es 8) 5 2)) we 14510 SS] soe 7 
ao 18 O20 o4 12 13744 V2 2 oe Toe. 
P27 3365 ZAUOe | 2 74 Oy 6 i 6 ag 25 
73 3841 ZA tae fe LOST 2 52370-2075 13458 
ee Bets. 204 Ege 76 UPS Vad Qe 66 13078 
ooo 3 22 ie ed a, 14787 92262923 T3i24 
(omes ol? L Be oegy 22 78 kes Ie 3526. 993 14095 
(a2 oT 7 alg ao Ct 79 ee eae, 7174.588 Nie 7) 8 


Peels shegress On: 7 Y= 28550594 =.3.793) x 


3. Regression Line Adjusted for Serial Correlation: 


Yea] = ry, + a(l-r) + OX 4 ~ pxrX, 

= - 4 ; : soA6 (4 
Yea] {,446) (13919) +15188.2496 3.4098X, 5 + (3 4098) 1.446 )-(4297)) 
ae =e 7930.6 157 35 = 3.4098, 5 


A. Data Table: 


2 


Kea oat =e Sy Sos ne) ast 
1000 24521 15188245.69 3488 7482 
2000 Zaiibatel 8056099. 446 2540 5449 
3000 17701 4147349.016 1823 3910 
Saris 15270 3328866.905 ese 3503 
4000 14292 ae oe Ol iecS Goi 
5000 10882 5999981.585 2192 4702 
6000 7472 iielace. se 3070 6585 
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TOTAL PROCUREMENT IN BUDGET-YEAR-PLUS-TWO (billions) 
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FIGURE 3 





DATA POINTS xX X x 
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Go CONPIDENCEBANDSaAy “02 eas 


Yeu, = 27930.87573 - 3.409844, 


ie 2.0 a0 4.0 5.0 
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es 
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FIGURE 4 


Yes] = -446Y_ + 15188.2496 - 3.4098X,,, + (3.4098) (.446)X, 


Re = (478 
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E. TOTAL PROCUREMENT IN PROGRAM YEARS VS. 
IN BUDGET YEAR 


RDT&E, N 


ale Observed Variables, Variables in Generalized 
Difference Form (r=.863), and Ex Post Forecast. 
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V. THE CONCLUSIONS 


A. ANALYSIS OF REGRESSION RESULTS 
Discussion of the regression results will proceed in 
generally the same sequence as the presentations in the 
Prewtous Section. Since the explanatory variable of each 
regression is RDT&E,N in the budget year, third-order headings 
which follow will refer only to the dependent variables of 
the regressions to be discussed. 
1. Forecasting A Single Year's Procurement 

Secetons 1[V.A,71V;B, 1V.Cy and IV.D present the 
results of the analyses of the relationships between current 
RDT&E,N and a single year of total Navy procurement one, 
two, three, and four years in the future, respectively. 
The results are not very impressive. Ex post forecasts 
results in R° Searls t Les rO fire 3505 bee 6b eo Senco 2s 
indicating that in each case less than half of the procure- 
ment variance is "explained" by the earlier effort in RDT&E. 
Piecadltlon, the widths of the 95% centidence intervels 
about these models' point estimates are excessive. The 
average value of the dependent variable during the period 
under study is approximately $15000 million, and these 
models provide confidence intervals of between $5384 million 
amege@s7286 million in width (beth sides). Such statistical 
accuracy would appear to be of little use, even at the 


95% level of significance. Finally, these four regressions 


5) 5) 





BaePpcat “LO;haAvVe Very little relation to one another. 
The adjusted regression lines have a sharply negative 
Slope for the first two analyses. The third year's 
adgusted regression line is sharply positive in slope, 
and the fourth year's regression provides a line of only 
slightly positive slope. One would expect either more 
consistency among these regressions or some sort of trend. 
Neither characteristic is in evidence, and the absence of 
any pattern suggests that the time period covered by the 
dependent variable (one year) may be too short. 
eee OG ecaseine TOtal Procumenent In tre Progman Years 

Section IV.E displays the results of the analysis 
of the relationship between RDT&E,N in the budget year 
and total procurement in the following four years (the 
program years) collectively rather than individually. The 
ex post forecast in this case results ina Re Sis Jo Neri 
eos. Confidence interval of S10092 million. The RO 
Statistic is impressive in that nearly ninety percent of 
the variation of the dependent variable is "explained" by 
the model, and the confidence interval, when compared to 
the average value of the dependent variable during the 
Bemied studied, 5586/0 million, suggests that the statis- 
Meal tpeliability of this model is Superior to chose pro- 
duced by the single year analyses. 

In spite of the apparent success of this analysis, 
ene serious cCifficulty remains to be discussed: the nega- 


tive slope of the adjusted regression. The OPNAV/NAVCOMPT 
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analysis at the very least implied that the relationship 
between RDT&E and future procurement was direct in nature; 
that the more spent now on RDT&E, the more we could expect 
to spend on future procurement. However, both the regression 
Besules and visual inspection of the Gata plotted over 
time (Figure 10) reveal that, on the macro level since 
1962, the overall trend in total Navy procurement has 

been negative, while the trend in RDT&E,N has been posi- 
tive. This conflict leads logically to expansion of the 
Study in two directions, both of which will be discussed 
in the sections to follow. 


3. Forecasting Aircraft and Missile (PAMN, APN, 
WPN) Procurement in the Progeam “ears 


In order to explore the possibility of a closer 
and/or more direct relationship existing between RDT&E 
and selected future procurements, the analysis presented 
in Section IV.F was conducted. Of the five current Department- 
of-the-Navy procurement accounts, PAMN (divided into WPN 
anG@ewAPN since 1974) was thougnt to be probably the most 
influenced by research and development. Thus, an analysis 
of budget year RDT&E,N in relation to program years’ 
collective PAMN might prove revealing. 

Mae analysis resulted in ex post forecasts and a 
ne Seacistic Of .765 and a confidence interval of 33695 
million in comparison with average value of the dependent 
variable of $22884 million. This R- value is a little 


less than that of the previous analysis, but the confidence 


=e 





interval is a little narrower. The indication is that this 
Melationship 1S neither significantly better nor signifi-— 
cantly worse than that matching RDT&E with total procure- 
ment. In addition, the model produced has a negative 

Slope as did the previous regression. Thus, the expected 
results did not materialize. Although further attempts at 
Factoring the data may well yield more useful results, 

this study explores another avenue. 


4. Total Procurement in the Program Years 
(Reducing the Time Span) 


In attempting to forecast by means of time-series 
data, there always exists a danger that one or more of the 
basic relationships among the variables involved may have 
Cfanged during the period under study. Concern for this 
danger seems particularly appropriate with regard to this 
analysis (specifically, the analysis presented in Section 
IV.E above). The time period studied includes the Vietnam 
War and the extraordinary impact it must have nad on speci- 
fic Navy procurement actions and on the entire Navy budget 
in general. In addition, the very nature of changing tech- 
Notegy provides a logical basis for arguments that earlier 
Gaeaee.g. data prior to 1970 or 1973) are not valid; and 
visual inspection of the data tends to support this con- 
tention. Note that the last few data-point relationships 
seem to indicate a direct relationship between the variables: 
as RDT&E begins to increase, procurement increases also. 


See Figure i2. 
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In response to this, regressions were conducted 
using fewer data points; that is, earlier data were ignored. 
Sections IV.G and IV.H present analyses which use only the 
previous eleven and eight data pairs, respectively. The 
relationship is again between RDT&E,N in the budget vear 
and total Navy procurement in the program years. The 
results are interesting in that the slope of the adjusted 
regression lines become more positive as more early data 
are lgnored; this indicates that the supposition that the 
basic relationship has changed may have some validity. At 
the same time, however, the width and shape of the 95% 
confidence interval appear to have deteriorated to the point 
of making forecasts much less reliable. If the regression 
resulting from an analysis of only the last eight data 
points (IV.H) is the most representative of the true relation- 
ship between the variables, then there is no alternative 
DummEO accept a 95% confidence interval which is 3135374 
million wide at best (i.e. the next explanatory variable 
is equal to the average of the previous eight) and which 
mepmincrease rapidly as the next explanatory varzabie 
varies from the average. 

Note also that the R? Statist tes Forerne ez 2OST 
Poeeeasts conducted using only the most recente eleven and 
Seer daca Doints fall to ./6/ and 2.506, respeceively. 
Although this indicates a deterioration in the goodness 


@ereit, the amount of variation in the observed dependent 


Se, 





variable is also a good deal less in these regressions than 

in those conducted with all fourteen data points. Since 

the Re Statistic is constructed using the squares of the 
deviations about the mean of the observed values of the 
dependent variable, it becomes more difficult, proportionately, 
to achieve the same eG Statistic when these deviations are 
smaller. In other words, the relatively low Re statistics 

May not in these cases be cause for rejection of these 
regressions. 

An additional interesting result occurs when com- 
paring the predictions of the three different models for 
the same reasonable value of the explanatory variable, 
for instance $4000 million (by reasonable, we mean in the 
range of experience of the explanatory variable). The 


~ 


point estimates (Y ) produced by the fourteen-, eleven-, 


eal 
and eight-data-point regressions are $55349 million, $54879 
fie, and S55064 million, respectively. Thus, the point-= 
estimate forecasts of the models are so close as to make 
their differences negligible. This is partially explained 
Pygeet= ace that the three models all have the most recent 
elght data points in common and that, by design, the more 
recent data have more impact on the model. Unfortunately, 
neither the proximity of the estimates nor the explanation 
for it helps to resolve the question of the true nature 


of the relationship between these two variables. The point 


estimates may be close, but each model responds quite 
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Giese rently to changes in the explanatory variable. Thus, 
the choice of model is still crucial to the budget analyst, 
who is most often faced with decisions of an incremental 


nature. 


Bem coulSsING STATEMENTS 
Be Suggestions for Pureher Study 

Although necessarily limited, this study may well 
Paemiedera Stepping-Ooff Point for further analyses. It 
Deerd seem logical that the predictability of future 
Peeeurement could be improved if additional explanatory 
variables were included in the model (e.g. GNP, total DOD 
budget, total Federal Budget, the unemployment rate). 
Lack of sufficient and relevant time-series data might in 
this way be overcome by pooling whatever time-series data 
are available with cross-section data. Of course, the 
methodology of multi-variable forecasting and the process 
of handling error disturbances are considerably more sophis- 
ticated than those used in this thesis. However, in view 
of the results achieved with just RDT&E, more useful and 
accurate predictions might be expected. 

Ze Hypothesis 

With regard to the general working hypothesis 
Peoposcea at the outset, 1lt 1S concluded that cnere does 
exist a statistically valid predictive relationship between 
current Navy research and development and future Navy pro- 


curement, taking the program years as a whole. Whether 
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the relationships discovered in this thesis are close 
enough to prove useful to those who shape future Navy 
budgets remains open to question. Probably the most 
common failing of forecasting with time-series data is due 
to an unwarranted emphasis on the past rather than the 
future. Additionally, the temptation to attribute cauSse- 
and-effect qualities to purely predictive relationships is 
always present. The quality and usefulness of the models 
developed above or those which may follow should be based 
upon how well they predict the future, and, if a basic 
relationship can change, it must always be kept in mind that 


during the period being predicted, it just might! 
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APPENDIX A 


THE OPNAV MEMORANDUM 


DEPARTMENT OF THE NAVY 
OFFICE OF THE CHIEF OF MAVAL OPERATIONS 


WASHINGTON, O.C. 20350 
iN REPLY REFER TO 


Ser- 9225217 507 520 





24 APR 1978 


MEMORANDUM FOR SUPERINTENDENT, NAVAL POSTGRADUATE SCHOOL 


Sub}: Proposed Study Subject for Financial Management 
Students 


EnGl om (1) Discussion Paper 


The purpose of this memorandum is to recommend a subject 
for study by your financial management students. I believe 
ene study would provide results useful to those of us involved 
in shaping future Navy budgets and be an excellent project for 
amaster's thesis. 


The ever increasing complexity and cost of modern weapons 
Systems is a familiar theme and we are indeed seeing more and 
more instances where the development of a promising new system 
PS terminated simply because its predicted procurement costs 
make the system non-aftordable. Nonetheless, the research and 
development program for the Department of Defense continues to 
receive increased emphasis during each year's budget delibera- 
tions. For example, the Navy's Research, Development, Test 
and Evaluation (RDT&E) appropriation for FY 1979 is funded at 
a level which provides a program real growth of approximately 
Six percent over the FY 1978 level. In order to project the 
magnitude of future Navy budgets that can be anticipated as 2 
PesUireor, the Continued enmplasis 2 ~esearcm and ceveloumen., 
my staff recently prepared an analysis of the potential procure- 
ment costs inherent in the on-going R&D programs presently 
funded in the RDT&E appropriation. The objective of the analysis 
was to develop, if possible, a prediction model that would help 
answer the question .... “Given a certain level of funding in 
research and development programs, what follow-on procurement 
ees. SoCal: De expecied?” 


Although the analysis performed by my staff was intentionally 
Pimicved. it did produce a rough indicator of approximately four 
Sellars Of DIOcUremMenNn® CoOses fom Very collar Of Rad, and 
Vielded Several Interesting Observations. For example, one 
peoeran nad am-estimated procurement cost 54° times greater 
than its development cost, while other programs were noted to 
gst more to develop than to procure: “Enclosure (1) provides 
deditional backeroumd sand acdiscussion of the approach used oy 
my start. 
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[uDj}: Proposed Study Subject for Financial Management 
Students (continued) 


It is anticipated that appropriate research and analysis of 
the historical relationship between known procurement and 
development costs would produce numerical factors that reflect 
the number of procurement dollars required for every dollar of 
R&D. It is envisioned that the development programs would be 
Categorized by some appropriate scheme such as functional type 
Sa Mission +area. C.¢. == Alrcratt, missiles. radar systems, Sonar 
Svstems, etc., and that there would be a different factor for 
each category. The factors could be used as models to provide 
26 east a rowen answer to questions such as...<0"lf I have $10 
million RDT&E funds invested in advanced surface-sonar systems 
development programs, how many follow-on procurement dollars will 
be required?" In order to keep the study effort to a manageable 
level and within the ability of the students to accomplish as a 
thesis project, I recommend that the scope be limited to purely 
pljencial vamalysis Without regard to the cost-eftectiveness of 
the varlous weapon. systems. 


Ny epotnw@roeucomcacre cor this proposed area sof study is 
Meee cnaeles iP. Nemiakos. Associate Director, Budget. 1 wall 


welcome any comments that you or your staff may have concernin 
Bis project. ; 


eee 
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RETURN ON INVESTMENT IN R&D PROGRAMS 


fe) The best indicator of the amount of future procurement 
dollars associated with new weapons systems now in development 
1s an analysis of those programs in the engineering development 
Stage of the total research and development program. It is 
these programs that have passed a major milestone in the system 
acquisition decision process and are the most likely to. complete 
development and enter production. Many of the programs in 
engineering development already have budget quality estimates 

Of thelr procurement price tag. For those programs whose procure- 
ment cost has not yet been priced out, we can at least obtain 

an order-of-magnitude, ball-park estimate of procurement cost 
using an empirically derived prediction factor. In order to 
derive such a factor for FY 1979, NAVCOMPT analyzed a represen- 
tative sample of programs in engineering development in FY 1979 
for which budget quality estimates of total development and 
total procurement costs were available. From the analysis a 
relationship of approximately four dollars of procurement for 
every dollar of R&D was derived. Using this predictor, we 
filled in the holes in the procurement cost estimates associated 
with our R&D programs in engineering development. 


fe) The NAVCOMPT analysis used a very small data base of 
approximately 20 programs, as shown in Tab 1. These programs 
Wereoall In the Fr) 1975 Sudger and 11 tne encinecering develop- 
ment stage of their development program. Each of these programs 
had progressed to the point that budget-quality estimates of the 
total R&D costs and total procurement costs were available. The 
programs were selected in such a manner as to provide a cross- 
section sample of the various development technologies within 
the total R&D programs. 


0) A more accurate analysis of the relationship between 
procurement and development costs would, of course, require 

a larger data base. The minimum requirement is that both total 
R&D and procurement costs be known -- thus the data base 1s 
largely historical in nature. Tlor-year RDTIGE budgets will 
necessarily provide the majority of programs in the sample 

as these budgets will contain more programs for which actual 
total R&D and procurement costs are available. Current year 
and budget year budgets also can be analyzed as budget-quality 
estimates of total R&D and procurement costs can be considered 
as "known" costs. 


fe) In order to obtain return-on-investment factors that 
aceueately ceseribe the sample, Gach programs ‘contribution 
must be weighted by the ratio of its dollar value to the total 
dollar value of the sample. For example, there may be programs 
whose procurement-to-development cost factor is 40, but whose 


ENCLOSURE 1) 
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impact on tne overall factor is minimal because that program's 
R&D dollar value represented only one percent of the total 
sample's dollar value. 


fe) The NAVCOMPT analysis considered only total procurement 
and total R&D costs. The possible affect of unit cost and 
production quantities was not analyzed. A more extensive 

Study of procurement and R&D cost relationships should consider 
Ene inpact Of a larce production quantity or a production run 
over a long period of time. 
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SAMPLE PROGRAIIS. 


‘4 Z g 4 5 
7 FY 79 AMT feaeeon Wen anned 

Program BPR (S$ in M's) of Sample Factor 
F~-18 Sy5 473.6 42 2ea5 
Lamps IIIf dey 24> ry a 258 
TACTAS = Pil ee 202 216 
HARM 4.8 344 04 ee 
TOMAHAWK i.e Hes) ame A ee 123 
STD MSL IMP 325 Canes 04 ae 
TRIDENT I MSL ae £91. 3 ae wo, 
SURTASS 5.0 5.6 .006 AOE 
ASPJ 6 oe aes .009 0m: 
MCLWG Se see -V0Z 04 
ABN ASW Pods el eG <00. 20%: 
Adaptive BOM 4.4 5.8 7005 U2 
SPN-42 RADAR 4.5 Beye 2003 mo) 
Spec W/F Craft -6 6.0 5005 - Om 
ADV RADAR WARNING Ce ra ao .0005 1Oz 
Helo Night Vision t8 rs 3005 . 06 
ALr=Air MSL SYS 4 2815 ASE mee 
Cre COMy 8.0 dak .006 oS 

1136.4 L000 4.20 


PY 79 Weighted Multiplier (Preocusement to R&D) ="4.2 


Paceisw Ofai TAB 1 
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SAMPLE PROGRAMS == LEGEND 


COLUMN DESCRIPTION 

l Program  shora ticle 

Z Ratio.f total procurement 
COS&S sco LOtal RED Gosces 

5 Amount of dollars budgeted 

: in the FY 79 RDT&EN budget 

4 Fraction representing each 
Drograms ~“SNare of the toLat 
sample 

5 Wetgnted procurement -to- 


development factor obtained 
by multiplying columns 2 and 4 


Page 2 of 2 TAB 1 
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APPENDIX B 


GLOSSARY OF TERMS AND ABBREVIATIONS 


adjusted regression - An Ordinary least squares regression 


APN = 


Ape~Oooriation. = 


PGEenerlzation = 


Autoregression - 


Bu@G@et activity - 


which has been corrected for the serial 
COrrelation Of Ehe error terms  [Rets., 10 
and 12}. 


ADPTOPELarroOn Elvcles Aireratt. Procurement. 
Navy [Ref. 8]. 


An annual authorization by Act of Congress 
COvineCUr JObligagions for specitiec sur— 
poses and to make payments out of the 
Treasury. Synonyms: budget authority 

and mew obligational authority [Ref. 5]. 


Substantive law which must be passed by 
COnNGreSs PHIOn tO any “appro pre iatiom which 
specifies the amount and purposes for which 
money may be used. This requirement, which 
Originally applied only to procurement of 
aircraft, missiles, and ships, has been 
expanded year-by-year to other categories 
until now it includes procurement of 
tracked combat vehicles and other weavons, 
RDC Miheary <cOnstcuerion, -oOrpedeecs, 
reserve and active duty personnel strength 
(Ref. 4]. 


PecOnGsCL One En wale tae error. terms —& som 
different observations are correlated; the 
GftecevOb 42h error GlSeurbance In one 
period carries over into another period. 
Synonym: serial correlation [Refs. 10 
encan2 |. 


The major subdivisions of each budget 
appropriation account as submitted to 

and approved by Congress (@.g., the budget 
Sacelvietes AS cor [tiseel. year 1974 5or 

the RDT&E,N appropriation are: Technologv 
base, advanced technology development, 
strategic programs, tactical programs, 
intelligence and communications, program- 
wide management and support) [Reft. 2}. 
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Buagee MauULNOrL ey. 


Budget plan 


Budget year 


Budgeting 


@e@nstant acliars 


Crosswalking 


Current dollars 


DOD program category 


BOOnOMetrics 


BeE@momic TrOrecasting 


Pe OOSt Lorecast 


pi ona heatEnOrl Zak lon oy jac tur 
COnGEessS Or TMGUr Io Ligataons £ou 
Specific purposes and to make payments 
out of the Treasury. Synonyms: appro- 
priation, new obligational authority 
(Ref. 7]. 


That portion of the programming-and- 
financing section of the Federal budget 
request which shows by budget activity 
the amounts for procurement actions 
programmed and the manner in which the 
total amount is being financed [Refs. 

7 rand 3). 


2ne- CUrEbent £iscalyyearm plus sone «| Ret. 


| 


The process of translating approved 
resource requirements (manpower and 
material) into time-phased financial 
requirements [Ref. 5]. 


Costs expressed in terms of the price 
levels prevailing in the base year 
(Piel o7o Becks Case} an Reg otss | 1 


The process of transforming or trans- 
lating the budget from DOD program 
category to appropriation budget 
activity and vice versa [Ref. 1]. 


Costs expressed in terms of the price 
levels prevailing when those costs 
were incurred, obligated, and/or 
expended [{Ref. 5]. 


- One of the ten major program cate- 
gories outlined by the Department of 
Defense which are objective-, goal-, 
mission-, and/or output-oriented [Ref. 


ae 


The development and use of mathematical 
models representing portions of the 
real world [{Ref. 12]. 


~ The quantitative estimation about 
the likelihood of future events based 
On past and currents  intormetione| Ret 12). 


A quantitative estimation about the like- 
lihood of an event during a past time 
period when the value of both explanatory 
and dependent variables are known with 
Certainty. nef «nize 
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Expenditure 


A charge against available funds which 
represene the actual payment of cash. 
Synonym: outlay [Ref. 5]. 


New obligational authority (NOA) - An annual authorization 


Obligation 


OPN 


DY ~ACe Or JGongress tO incur Obligations 
for specified purposes and to make 
payments out of the Treasury. Synonym: 
appropriation, budgec vauchority 

[Rei 5% 


A legal reservation of a specified amount 
of an appropriation for expenditure 
(Ret =. 25:15 


An PapPECprlatton tlele-n Other Procure— 
ment, Navy [Ref. 8]. 


Ordinary least squares (OLS) regression - A procedure for 


Out lay 


PAMN 


PMG 


Peoegr am 


PeQgramn Years 


determining the statistical relationship 
between two variables by calculating 

the equation for a straight line which 
minimizes the sum of the squared 
deviations (observed-calculated) of 

the dependent variable [Ref. 11]. 


A charge against available funds repre- 
senting the actual payment of cash. 
Synonum: expenditure [Ref. 7]. 


An old appropriation title: Procurement 
of Aircraft and Missiles, Navy. (This 
appropriation was divided into APN and 
WEN in 19/4). {Rees 8) 


Pty “apREOprlaeron sELe e:-) Precuremenc, 
Marine Corps [Rer.. 4]. 


A plan or scheme of action designed for 
the accomplishment of a definite 
objective which is specific as to the 
time-phasing of the work to be done and 
the means proposed for its accomplishment, 
particularly in quantitative terms, with 
respect to manpower, material, and 
facilities requirements. Provides the 
basis for budgeting [Ref. 5]. 


The four fiscal years beyond the budget 
year [Ref. 5]. 
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Programming - 


Re statistic - 


Reimbursable - 


Reimbursements 


The progcess of translating planned mili- 
tary force requirements into time-phased 
manpower and material resource require- 
ments [Ref. 5]. 


A statistic which represents the goodness 
of fit of the line provided by the 
regression procedure versus the observed 
occurrence [{Ref. ll}. 


An appropriation title: Research, 
Development, Test and Evaluation, 
Navy [Ref. 8]. 


An amount added to the total direct 
program which reflects the value of 
acuervyilty .COnauceced 111 SUDPOrE, OF CEner 
governmental agencies or programs [Ref. 7]. 


When authorized by law, amounts collected 
for materials or services furnished to 
the public or other government agencies 
[Ref. 7]. 


Selected Acquisition Report (SAR) - A report prepared for 


Serial correlation 


Time-series data - 


the Secretary of Defense which summar- 
izes current estimates of technical, 
schedule, and cost performance of Navy 
development and procurement programs in 
comparison with original plans and the 
CuUSrent program )|Rers. 93 -end 6). 


~-~ The error terms from different 
observations are correlated; the effect 
of an error disturbance in one period 
carries over into another period. 


Synonym: autoregression [Rers. 10 and 12]. 


Observations of the value of explana- 
tory and dependent variables which are 
Collected over time, |Ret. 12/]- 


Geral direct program - The total value of actions pro- 


grammed in direct support of the budget 
activities making up an appropriation. 
Synod) SOLalLwobligat l@na ls avEnor ay 
(TOA) [Ret. <8]. 


ee 





ioeal Obligational Authority (TOA) -— -The total amount of 


funds available for programming in a 
given year, regardless of the year the 
funds are appropriated, obligated, or 
expended. It includes new obligational 
authority, unprogrammed obligational 
aAULROrITYy From DilOr Yeats, teimburse— 
ments not used for replacement of inven-_ 
tory in kind, advance funding for programs 
to be financed in the future, and 
unobligated balances transfered from 
O°ENer SperOrprlatrons. | Synonym: (tocar 
divect+erecgwam |Ret.2-5 |. 


An appropriation title: Weapons 
Procurement, Navy [Ref. 8]. 
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